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Abstract —Cross-layer scheduling is a promising way to im¬ 
prove Quality of Service (QoS) given a power constraint. In 
this paper, we investigate the system with random data arrival 
and adaptive transmission. Prohabilistic scheduling strategies 
aware of the buffer state are applied to generalize conventional 
deterministic scheduling. Based on this, the average delay and 
power consumption are analysed by Markov reward process. The 
optimal delay-power tradeoff curve is the Pareto frontier of the 
feasible delay-power region. It is proved that the optimal delay- 
power tradeoff is piecewise-llnear, whose vertices are obtained by 
deterministic strategies. Moreover, the corresponding strategies 
of the optimal tradeoff curve are threshold-based, hence can be 
obtained by a proposed effective algorithm. On the other hand, 
we formulate a linear programming to minimize the average 
delay given a fixed power constraint. By varying the power 
constraint, the optimal delay-power tradeoff curve can also be 
obtained, ft is demonstrated that the algorithm result and the 
optimization result match each other, and are further validated 
by Monte-Carlo simulation. 

I. Introduction 

Real-time services such as instant messenger (IM), social 
network service (SNS) and streaming media are experiencing 
a period of rapid growth, therefore are specially concerned 
by next generation networks. Services of this sort all have 
high requirements for manipulated delay. However, due to the 
randomness of the workload and the architecture of traditional 
packet-switched communication network, delay is not easy to 
analyse or control. It is widely acknowledged that there is 
a fundamental tradeoff between the average queueing delay 
and the power consumption. Therefore to achieve better QoS, 
cross-layer optimization with traffic and energy management 
is well studied and accepted. 

One of the major methods of achieving the optimal delay 
is dynamic programming. To our best knowledge, la is one 
of the earliest work to study cross-layer scheduling model 
considering a time-varying channel and average delay con¬ 
straints. Berry and Gallager investigated adapting the user’s 
transmission rate and power over a fading channel in ID. The 
optimal power-delay tradeoff was achieved using Markov de¬ 
cision process formulation and dynamic programming. Based 
on this, the existence of stationary optimal scheduling as well 
as the lower and upper bounds of the optimal policy was 
discovered in El. Detailed power/rate adaptation was further 
studied in |j4l, where analytic analysis for asymptotically large 
buffer size was conducted. In Qj Ata modelled the problem as 
a continuous-time Markov chain under the assumption of hxed 


channel, Poisson arrival and exponentially distributed packet 
size. Instead of considering average delay, hard deadline as 
well as static channel assumption was considered in ||6l, 
where lazy scheduling was proposed to minimize the total 
energy consumption. A cumulative curves methodology was 
investigated in 171 so that energy-efficient transmission with 
deadline constraint and continuous-time optimization can be 
achieved. In El, closed-form optimal policy for two times¬ 
lots and numerical optimal policy for more timeslots were 
obtained, which were found to be a linear combination of 
a delay-associated term and a channel-aware term. K-block 
delay constraint with causal feedback of the channel state was 
imposed in l9l. 

In our previous work noi, we investigated the situation 
where data packets arrive randomly and the channel is time- 
varying. We proposed a cross-layer method to achieve closed- 
form delay-power tradeoff and optimal scheduling strategy by 
a hxed-modulation scheme. Eurthermore, in order to apply our 
formulation to various problems, the long-coherent-time and 
short-coherent-time cases were studied respectively in ifTTll and 
ifTTIl . All the above work is based on simple communication 
protocols with hxed modulation and coding scheme so that the 
computation and energy cost can be saved. However, adaptive 
transmission rate is widely supported for many application 
scenarios. Therefore we advance a new approach to analysing 
the system with adaptive transmission in this paper. 

The remainder of this paper is organized as follows. The 
system model is established in Section II. We formulate the 
problem as a Markov reward process in Section III, based on 
which the average power consumption and the average delay 
are analysed and expressed by steady-state probability distri¬ 
bution. In Section IV we investigate some properties of the 
scheduling strategies. It is discovered that the feasible delay- 
power region is a polyhedron, whose vertices are obtained 
by deterministic scheduling. The optimal delay-power tradeoff 
curve, as the Pareto frontier of the polyhedron, is piecewise 
linear. Moreover, the optimal scheduling is threshold-based, 
thus an algorithm is proposed to obtain the optimal tradeoff 
curve. In Section V, we formulate a linear programming to 
minimize the average delay given an average power constraint. 
By varying the power constraint, the optimal tradeoff curve 
can also be acquired. It is demonstrated that the algorithm, 
the optimization and the simulation results completely match 
each other in Section VI. Section VII concludes the paper. 



II. System Model 

Consider the system model shown in FiglT] We assume that 
at the beginning of each timeslot, data arrive as a Bernoulli 
Process with parameter a. Each incoming data packet contains 
A bits. Denote a[n] = 1 or 0 as whether or not there are data 
arriving in timeslot n, hence 

f Pr{a[n] = 1} = a, 

|Pr{a[n] = 0} = 1 — a. 

Denote s[n] as the number of data bits transmitted in 
timeslot n. Because of the constraints of the transmitter, in 
each timeslot at most M bits can be transmitted. In order 
to guarantee the stability of the system, we set M > A. 
Assume transmitting m bits will cost power Pm- Transmitting 
0 bit will cost no power, hence Pq = 0. From perspective 
of the physical layer, to transmit more bits without increasing 
the error rate, we should use a larger constellation diagram, 
therefore more power has to be consumed for every bit in 

P P 

average, i.e. if mi < m 2 . More details can be 

found in where information-theoretic explanations and a 
few examples are provided to support this point. 

To temporarily store the backlog data, a buffer is introduced. 
Assume the buffer can restore at most Q bits. Denote q[n] as 
the number of bits in the buffer at the beginning of timeslot 
n. Therefore in timeslot n, we can decide how many bits 
to be transmitted based on the buffer state ^[n] and the 
data arrival a[n]. To extend from traditional deterministic 
scheduling methods so that a better delay-power tradeoff 
curve can be achieved, we investigate probabilistic scheduling 
policies. In other words, given q[n] and a[n], the value of s[n] 
is determined by a probability distribution. In each timeslot, 
the transmission is scheduled after the data arrival, thus when 
deciding how many bits should be transmitted, there are 
{q\n] + Aa[ri\) bits data in total. Denote t[n] = q\n] + Aa[n] 
and K = Q + A. For transmission, there is no need to 
distinguish the newly arrived data from the backlog data, 
therefore we denote fk,m as the probability to transmit m 
bits when t[n] = k, i.e. 

fk,m = Pr{s[n] = m\t[n] = k}. (2) 

Immediately we have 

M 

Y,fk,^ = l yk = 0,---,K. (3) 

m—0 


Denote F as a {K -f 1) x (M -f 1) matrix whose element 
in the (fc -f l)th row and the (m + l)th column is fk,m- We 
guarantee that the transmission strategy will avoid overflow or 
underflow, which means m = 0 if k — m < 0 or k — m > Q. 
Therefore the following equation should hold 

q[n + 1] = q[n] + Aa[n] — s[n], (4) 

t[n -f 1] = t[n] — s[n] + Aa[n + 1]. (5) 


III. Markov Reward Process 

As described in the above section, the scheduler will decide 
how many bits to be transmitted based on the information of 
the queue length and the data arrival state. Since a[n] is i.i.d., 
s[n] is determined by t[n], based on Q we have 

Pr{f[n-f l]|f[n], • • • , f[l]} = Pr{f[n-f l]|f[n]}. (6) 

Hence the stochastic process {f[n]} is Markovian. Therefore 
we can formulate the problem as a Markov Reward Process 
(MRP), where the average delay and power are the rewards of 
the Markov process. Denote Hk as the steady-state probability 
for t[n\ = k. Denote Xij as the transition probability from 
state i to state j. The transition diagram is shown in FiglU 
where for i = 0, - ■ ■ ,K are omitted to keep the diagram 
legible. The transition from state i to state j is made up of at 
most two cases. One is transmitting (i — j) bits and then there 
are no data arriving. The other is transmitting (i — j + A) bits 
and then there are data arriving. Therefore we have 


^i,3 ~ 

' (1 - 

(1 - a)kt-3 
(1 - a)fi,i-3 
' Pcy.fi,i-j+A 
Oifi,i—j+A 
C^fi,i—j+A 
,0 


M - A<i-j < M 
0<i — j<M — A, j<A 


0<i-j<M-A,A<j<K-A 


0<i — j<M — A, j>K — A 

—A <i — j < 0,j > A 

else 


( 7 ) 


Denote tt = [ttq, • • ■ , Denote Ap as a {K -f 1) x 

{K -f 1) matrix whose element in the (i -f l)th column and 
the {j + l)th row is A^j. It is determined by F. Denote I 
as the identity matrix, 1 = [1, • • • , 1]^, and 0 = [0, • • • , 0]^. 
We won’t specify their size if there is no ambiguity. Denote 
Gp — Ap — I. Therefore we have GpTv = 0 and I^tt = 

0^, we set Hp = 

Hence 


1. Since the sum of a 

1 rows in 

i^p is 



1 

Gp{0:iK-l),:) 

and c = 

0 


TT = Hp^C. 


( 8 ) 


In other words, Hp can be used to represent a certain 
transmission strategy. It will determine the value of tt. 

We can express the average delay and the average power 
consumption using the steady-state probability distribution. 
For state fc, transmitting m bits will cost Pm with probability 



















Fig. 2. Markov Chain of t[n] {K = 7, A = 2, M = S) 


fk,m- Denote Pp = [Em =0 

as a function of F, thus the average power consumption 




[0, • • • , ‘ ,0], where 5k is its {k + l)th column. Ap can 


K 


M 


be denoted as [0, 


P = Pmfk,m = Pf TT. (9) 

k—0 m—0 

Similarly, we can obtain that the average queue length is 

K 

Ex{( 7 [n]} = Ex{t[n] — a[n]} = ^ knk — aA. (10) 

k=0 

According to Little’s Law, the average delay is the quotient of 
the average queue length divided by the average arrival rate. 
Denote d = [0,1, • • • , AT]^, we have 

\k=0 / 

IV. Properties of Scheduling Strategies 
Erom above it can be seen that pp and Hp sit determined 
by F. Moreover, tt is determined hy Hp. Therefore a certain 
scheduling strategy F will determine a delay-power pair 
{P,D). Denote [Pp^Dp) as the delay-power pair generated 
by strategy F. The mapping from F to [Pp^Dp) has the 
following property. 

Theorem 1. F and F' are two scheduling strategies that are 
different only when t[n\ = k, i.e. the two matrices are different 
only in the {k + l)th row. Denote F" = (1 — e)i^-f eF' where 
0 < e < 1. Then 

1) There exists a certain 0 < e' < 1 so that Pp" = (1 — 
e')Pp -b e'Pp’ and Dp" = (1 — e')Dp + e'Dpi. Moreover, e' 
is a continuous nondecreasing function of e. 

2) When e changes from 0 to 1, point {Pp", Dp") moves 
on the line segment from {Pp,Dp) to {Pp/, Dpi). 

Proof: We will prove the two conclusions one by one. 

1) Erom the definition of Hp and pp, we can see that if 
F" = {l-e)F + eF', then Hp" = {I -e)Hp + tHp, and 
Pp" = (1 — e)pp -b epp,. Denote AH = Hp> — Hp and 
Ap = Pp, — Pp. Since F and F' are different only in the 
(fc-b l)th row, it can be derived that AH has nonzero element 
only in the (fc-b l)th column, and the (fc-b l)th element of Ap 
is its only nonzero element. Therefore AH can be denoted as 


element. Also, we denote Hp^ = 


, Cfe, • • • , 0] , where (k is its (fc -b l)th 

hi 

. Hence 


J 

{hl5k)hl 

ihlSk)hl 


{Hp^AH)Hp^ = 

{hli5k)hl _ 

By mathematical induction, we can have that for i > 1, 
{Hp^AH)^Hp^ 

{ hlSk ){ hlSky-^hl n 
{hlSk){hlSky-^hl 


( 12 ) 


{hySk)ihiSk)^-^hl 
={hl6ky-\Hp^AH)Hf} 


and 


Ap^H-p^Hp^AHy-^ 

=Ck{hlSky-^hl. 

Therefore the expansion 

(Hp + eAH)-^ 

+ 00 


(13) 


(14) 


(15) 


= J2{-eyiHp^AHyHf} 

+ 00 

=Hp^ + Y,{-^y{hl6k)^-\Hp^AH)Hp\ 


(16) 


(17) 


2=1 


-^cFHp^c — 1. Therefore 


Erom (|9]l and (fTlTi . we have Pp = p^Hp^c and Dp = 

'^Hp^c- 

Pp" — Pp 
Pp, — Pp 


{pp + eAp)'^{Hp + eAH) ^c-p^Hp^c 
' {ppPAp)'^{Hp + AH)-^c-plHp^c 


( 18 ) 










(19) 


( 31 ) 


pI [{Hf + eAH)-^ - ff-i] c 

+eAp^ [H F + eAH)~^c 

pI [{Hf + AH)-^-Hp^]c 
+Ap^{Hf + AH)~^c 




—Ap^ 

Y.tri{-^y[Hp^^Hy-^Hp^ 

c 

T 

Pp 

Ap^ 

l{-iy{hl5ky-\Hp^AH)Hp 

']c 

c 


Y.tri{-^y{hlSuy-^pl{Hp^AH)Hp^c 

-Y:iri{-^yuhi5,y-^-^' 


-^Kc 


i:tr,{-iy{K 5uy-^pi{H-^^AH)H-/c 
Ttr,{-ey{hi5,y-^ 


hlc 


ElrA-mKs.y-^ 

e + eh). Sk 
1 + ehf, Sk 


( 20 ) 


( 21 ) 

( 22 ) 

(23) 


and 


Df" — Dp 
Df' — Dp 

<f{HF + tAH)-^c - (fHp^c 
(f{HF + AH)-^c - cfHp^c 
d^{E^rA-^yihiSky-HHF^^H)Hp^)c 
d^(j:t:^ii-mhlSky-^iHp^AH)Hp^)c 
EtTii-eyjhiSky-^ 

EtTii-mhlSkY-^ 

e + eh^Sk 

1 + ^^k 


(24) 

(25) 

(26) 
(27) 


Hence 
Pp 


Pf'-Pf 

= {l-e')PF 


Dp-/' — Df _ 

Dpf —Df 

e'P f' and Df 


so that 


1+eh'^Sk 

' = (1 — 6')Df + Df’ ■ 


Moreover, it can be observed that e' = 




ous nondecreasing function. 

2) From the first part, we know 


l+£h^’<5j 
Ppn-Pp 


is a continu- 


Dp// —Df 


Pf,-Pf ~ Dfi-Df 
and e' is a continuous nondecreasing function of e. When e = 
0, e' = 0. When e = 1, e' = 1. Therefore when e changes 
from 0 to 1, the point {Pf", Df") moves on the line segment 
from {Pf,Df) to [Pf’, Df’)- The slope of the line is 


Df' — Df 
Pf' — Pp 

ijd^{HF + AH)-^c - ^d^H-/c 
{Pf + Ap)'^{Hf + AiT)-ic - p^Hp^c 
^d^{E^rA-^)yhlSky-^{Hp^AH)Hp^)c 
Et:^ii-^)yhlSk)^-^pliHp^AH)Hp^c 
-Etr^{-mk{hiSk)^-^hic 

^cfHp^AHHp^c 

p^Hp^AHHp^c-Ckhlc 


(28) 

(29) 


(30) 


d'^Hp^Sk 

aA{plHpHk - Ck) 

Theorem [T] indicates that the convex combination of 
scheduling strategies which are different only for one k will 
induce the convex combination of delay-power pairs. The 
slope of the line segment from {Pf,Df) to {Pf',Df') is 
obtained in (IbTT i. Furthermore, we can have the following 
enhanced conclusions, whose strict proofs are omitted because 
of space limitation. 

Corollary 1. The set of all feasible delay-power pairs is a 
polyhedron. The vertices of the polyhedron are all obtained 
by deterministic scheduling strategies. 

Denote 72. as the set of all possible delay-power pairs. 
Denote C as the convex hull of delay-power pairs generated 
by deterministic scheduling strategies. Corollary [T] actually 
demonstrate that P — C. However, what we concern most 
is the optimal delay-power tradeoff curve C = {{P,D) G 
72|V(P', D') G 72, either P' > P or 77' > 77}. In other 
words, £ is the Pareto frontier of 72. Based on Corollary [T] 
immediately we can have that 

Corollary 2. The optimal delay-power tradeoff curve is 
piecewise linear. The vertices of the curve are obtained by 
deterministic scheduling strategies. 

Moreover, the scheduling strategies leading to the optimal 
delay-power tradeoff have the following property. 

Theorem 2. The optimal scheduling strategy is threshold- 
based. That is to say, there exists [M + 1) thresholds fcp < 
ki < ■ ■ ■ < kM, one of which we denote as km*, such that 

{ fk,m — 1 1 k 'A km, TTl Tfi 

fk,m — 1 ^m*—1 'G k km* (32) 

fk^*,'m* P fk^* ,7n*+l — 1 

/fe.m = 0 else 

For simplicity and unification, denote fc_i = —1. More 
specifically, we have ko = 0, kA = kA+i = ■ ■ ■ = kM = K. 

The proof of Theorem |2] is also omitted because of space 
limitation. The theorem indicates that more data should be 
transmitted if the queue is longer. When km-i < t[n] < km, 
m bits should be transmitted. Any optimal scheduling strategy 
F has at most two decimal elements fk^,,m* and fk„,,m*+i, 
while the other elements are either 0 or 1. The strategies 
leading to two adjacent vertices and their line segment are 
only different for t[n] = km* - For the vertex with larger delay 
and less power, fk^,,m* = 1- For the vertex with smaller 
delay and more power, fk^*,m*+i = 1- This confirms that the 
vertices are obtained by deterministic strategies. 

Based on Corollary |2] and Theorem |2] we know that the 
optimal delay-power tradeoff curve is obtained by threshold- 
based strategy. The vertices of the piecewise linear curve are 
obtained by deterministic strategy. Therefore Algorithm [T] is 
proposed to effectively obtain the optimal delay-power tradeoff 































Algorithm 1 Obtain the Optimal Delay-Power Tradeoff 

initialize: 

1) Set F as a threshold-based deterministic strategy where 
km = min{m, A} for 0 < m < M 

2) Calculate the corresponding average delay dc and aver¬ 
age power consumption pc 

3) Denote set = {-F'} 
while J-c is not null do 

1) d 'p — 25 dp — dc, Pp — Pc^ d '2 — 05-5 — “t“00 

2) For every strategy in Jp, we take turns to increase each 
one of its threshold, thus generate a new strategy F each 
time. For every legal scheduling strategy F: 

if its corresponding average delay d and average power 
p satisfies d> dp and p < pp and < s 

then Fc = {F}, s = dc = d, pc = p 

else if its corresponding average delay d and average 
power p satisfies d > dp and p < pp and = s 
then add F into set Fc 

end if 

3) Draw the line segment connecting {pp,dp) and {pc,dc) 

end while 


curve. In the algorithm, we start from the bottom right vertex 
of the curve, and search for the next vertex on the optimal 
tradeoff curve one by one. 

V. Linear Programming Formulation 
In the above section, we analyse the optimal delay-power 
tradeoff as the Pareto frontier of the feasible delay-power 
region. In this section, we investigate the tradeoff curve from 
an optimization perspective. 

Based on ([8]) (|9l) and O, to achieve the minimum delay 
given a certain power constraint we formulate the follow¬ 
ing optimization problem 


min 

F,7r 

1 rr, 

—7d^7r — 1 

aA 

(33) 

s.t. 

PpTT < Pth 

(34) 


HpTr — c 

(35) 


TV P 0 

(36) 


fk,m = 0 yk — m<0 or k — m>K — A 

(37) 


where tt ^ 0 means tt is componentwise nonnegative. By 
varying the value of Pth, the corresponding optimal delay will 
be obtained. Hence the optimal delay-power tradeoff curve can 
be acquired. 

Define Xk,m = T^kfk,m- From Q, (|9]l and (fTTTi . we can 
express the average delay and power using Xk,m as 

K M 

(38) 


^ XV IVl 

^ ~ ^ E ^ E 

m=0 


From global equilibrium equations 

fc —1 l-\-A — k 

E E anifl^m 

Z=max{0,fc—A} m—0 


min{fc+M —1,K} r—k-\-A 

^ ^ ^ ^ (1 ^)'^r fr,m 

r—k m—r — k-\-l 

min{fc+M—l,/^} M 

+ ^ ^ ^ ^ '^rfr,7n A; = 1, * • * , K 

r—k m—r — k-\-A-\-l 

(40) 


we have 

fc-l Z+^-fc min{fc+M-l,_fC} M 

^ ^ ^ ^ ^ ^ ^ ^ ^r,m 

Z=max{0,fc-A} m—0 r—k m=r—fc+A+1 

min{k-\-M—l,K} r —fc+A 

-|- ^ ^ ^ ^ (1 C^)^r,m k — 1; * * * i P- 

r—k m=r —fc+1 

(41) 


The hazard of overflow or underflow can be eliminated by 
setting fk^m = 0 if k — m<0 or k — m>K — A, hence 
Xk,m = 0 if k — m<Q or k — m>K — A. Moreover, since 
= 1, we have J2k=o'i2m=o^k,m = 1- Therefore 
the original optimization problem can be transformed to 


K M 


aA'P^'P ^ 

fc=0 m—0 

K M 

(42) 

^ ^ ^ ^ Pm^k,m E Pth 

(43) 


k—0 m—0 

fc —1 Z+A—fc 

Z=max{0,fc —A} m—0 

min{k-\-M-l,K} M 

= E E 

r—k m—r — k-\-A-\-l 

min{k-\-M—l,K} r—k+A 

^ ^ ^ ^ (1 0!.')Xr^m k — 1, • • • , K 

r—k m—r — k-\-l 

(44) 


K M 

Y. Y = 1 (45) 

fc^O m—0 

Xk,m = 0 yk — m<0 or k — m>K — A (46) 

Xk,m >0 yo^k — m<K — A. (47) 


It can be observed that this is a linear programming problem. 
Based on mature algorithms such as simplex method or interior 
point method, the optimization can be well solved. 


VI. Numerical Results 

In this section, we validate our theoretical conclusions 
by conducting numerical computation and simulation. It will 
be confirmed that the optimal delay-power tradeoff curve 
obtained by the Pareto frontier of the feasible delay-power 









Fig. 3. Delay-Power Pairs Generated by Deterministic Strategies 


region and the one obtained by linear programming are the 
same. 

In Figl3 we show all the delay-power pairs generated by 
deterministic strategies. The parameters sae K = 7, A = 2, 
M = 3, a = 0.4, Pq — 0, Pi = 1, P 2 = 4, P 3 = 9. 
Hence the feasible delay-power region is the convex hull 
of all the points. Within these delay-power pairs, we mark 
the ones that are corresponding to threshold-based strategies 
with ’+’ markers. As we can see. Algorithm [T] obtains the 
Pareto frontier of the feasible delay-power region, which is 
the optimal delay-power tradeoff curve. The optimal tradeoff 
curve is piecewise linear, whose vertices are all obtained by 
threshold-based deterministic strategies. 

In Figli where K = 7, A = 2, M = 3, Pq = 0, Pi = 1, 
P 2 = 4, P 3 = 9, we demonstrate that the optimal delay-power 
tradeoff curve obtained by linear programming completely 
overlap the optimal tradeoff curve generated by Algorithm [T] 
The results are further validated by Monte-Carlo simulation. 
As is expected, the average delay decreases when the average 
power consumption increases. When the power constraint is 
no less than aPA, which corresponds to the initial strategy 
of Algorithm [T] the average delay decreases to 0 because any 
data will be immediately transmitted. With a increasing, the 
curve gets higher because of the heavier workload. 

VII. Conclusion 

In this paper, we investigate the buffer-aware probabilistic 
scheduling strategies and the corresponding average delay 
and power consumption. Specifically, random data arrival and 
adaptive transmission rate are considered. The average delay 
and power consumption are analysed by Markov reward pro¬ 
cess. Based on this, we discover that the feasible delay-power 
region is a polyhedron. The optimal delay-power tradeoff 
curve, as the Pareto frontier of the polyhedron, is piecewise 
linear, whose vertices are obtained by deterministic strategies. 
Furthermore, the optimal delay-power tradeoff is achieved 



Fig. 4. Optimal Delay-Power Tradeoff Curves 


by threshold-based strategies, thus an effective algorithm is 
proposed to obtain the optimal tradeoff curve. Moreover, 
seen from another angle, we formulate a linear programming 
problem to minimize the average delay given a fixed average 
power constraint. The optimal delay-power tradeoff curves 
obtained by the algorithm and the optimization problem match 
perfectly well, which are further validated by Monte-Carlo 
simulation. 
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